exploitable bug
Machine-learning boffins 'summon demons' in AI to find exploitable bugs
Surrounded by all the hype in AI, it's easy to sing the praises of machine learning without realizing that systems can be easily exploited. As governments, businesses, and hospitals are beginning to explore the use of machine learning for data analysis and decision making, it's important to bolster security. In a paper [PDF] ominously titled "Summoning Demons: The Pursuit of Exploitable Bugs in Machine Learning," a group of researchers from the University of Maryland are trying to find bugs by causing "silent failures." Machine learning systems have often been compared to black boxes. They are trained to map input data to output data by learning from an algorithm.